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I. Introductipn 


As science advances, with the resultine advances in technolocy. we 
have new tools and new canabilities which influence our world in many 
wavs. This new technolocy not only influences the traditional art form 
but also vroduses new forms of art. The development of hirh Snveed elec- 
tronic components and circuits, the cathode ray tube, the video camera, and 
inexoensive video tane recorders enabled the development of video art. The 
developnent of small but powerful computers now allows systems to he de- 
veloped which can sive the video artist a new dimension of control over the 
video imare. ith a computer-based video synthesizer (C2VS), one can 
generate a Segience of imases while controlling each indivj dual imase with 
detail and precision that is many orders of macnitude oreater than is 
possible with manual control. 

The ability to control the dynamics of the imare is useful to the 
artist only if the system is capable of weneratin- the inare in real tine, 
With this requirement in mind, the natural choice of devices for conver- 
ting electrical sicnals to visual images is the conventional video SYstem. 
This choice also gives the capability of recordins the video cornositions 
with a conventional video tape recorder and of broadcastine to a large 
audience throuvzh existine network systens. 

There are basically two modes of operation of the system: inter- 
active compositional mode and automatic production mode. In the compo- 
Sitional mode, the artist can enter prorrams and parameters throurh the 
keyboard, obseyve the resultinse sequence of imares, and then modify para- 
meters throurh either the keyboard or a real time input and thus build 
up a data set for a complete piece. At each Stape of the composition 
process the data set, representing all the aesthetic decisions made by 
the artist, is stored in the comouter. ‘When the composition is finished 
the system will operate in the automatic production node seneratine the 
final video sijmnal in real time with no intervention by the artist. The 
artist may als choose to use a combination of these two modes in an 
interactive performance or allow an audience to interact with the svsten 
operating automatically. The system is structured so that all of these 
variations can be accomodated by approvriate programminrc. 

The system may be operated as a generating synthesizer which produces: 
a video sirnal entirely from internal sirnals or as a processinpe svnthe- 
sizer which utilizes sisnals of external oririn such as a video camera. 
Fither of these two types of operations is carried out hy a conficuration 
of element modules, each of which performs a class of functions, with the 
specific function durinse one frame beins determined by the control parameters 
received from the computer. 

Since the computer functions only to generate the parameters which 
rovern the behavior of the synthesizer modules, a video signal will he 
generated without operation of the computer. The system will Simply repeat 
the frame until the parameters are changed. Thus the artist may choose 
to stop the computer in which case he is able to examine a single frame, 
or he may alter the program so that a given sequence is displayed very 
Slowly or repeated very rapidly. 
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II. ‘System Structure 


The CBVS consists of two parts: the computer section shown in the 
lower section of figure 1 and the video Section shown in ‘the upper section 
of the firure. 30th sections operate simultaneously and independently, 
communicatine through the buffer memorv which has a capacity of 1,024 
16 bit words. Fach of these words is either a picture element, a number 
which controls sone function of the video section and determines some 
aspect of one field of the video image, or it is a picture feature, a 
number determined by the video section and may depend on an external 
Sirnal such as a video camera siznal. ‘The buffer menory is connected 
to the computer bus throuch a 16 bit Darallel interface which is struc- 
tured in such a way that each word in the buffer memory is addressable 
and may be read or written in exactly the same way as words in the nain 
computer memory. This memory-mapped I/9 System simplifies the software 
wnich controls the buffer memory. in order to undate an element such 
as a control D/A, the computer must execute an instruction which stores 
the new value in the location correspondinr to that element. 

During the active scan time, the control computer reads features 
from the buffer memory and generates elements for the folfowine field and 
stores them in the buffer memory. During the vertical blankinr interval, 
information is transferred throurh the element bus from the buffer memory 
to the element modules or from the feature modules to the buffer menory. 
The desirnation of a particular area of the buffer memory as an element 
or feature is under program control, Durine the transfer between the 
buffer memory and the element bus, the computer is locked out of the suffer 
memory. On completion of the transfer, the interface renérates a vectored 
interrupt which requests the computer to menerate parametérs for the next 
Field. 

The computer system consists of: a PEC LST-1] microrYocessor which 
has a 16 bit word length and an instruction execution tind of about 7 
microseconds; Teletvne Keyboard and printer connected threuch a serial 
interface; 20 K of dynamic memory: a dual drive flonpv disk system with a 
capacity of 256,256 bytes per diskette. An additional serial interface 
is also available for connectinec through a modem to other comvouter systems. 
The entire system is dedicated to the synthesizer systen, 

The overall timine is dcetermined Dy a 9.7552434 ‘Hz d¢lock which is 
phase locked to the subcarrier (3.573545 “ldz). This Freavency is chosen 
to insure a coherent subcarrier and to divide the active portion of the 
Scan line into 512 pixels. The red, creen, and blue sisnals are renerated 
indevendently, and the chroma encodins is done with analoc circuits; thus 
there is no advantare to followin- the common practice of makine the pixel 
rate an interer multiple of the subcarrier frequency. ‘ith this clock 
Frequency, a full nine bit word is used to define the horizontal position 
On the active portion of the raster. Firure 2 shows the ¥ and Y wave forms, 
The X-Y module renerates twenty bits of timing information (ten bits for 
horizontal, includin« the Dlankine period, and ten for the line ccunt). 
This module algo senerates sync, drive, burst flas,jand the transfer request 
TR sirnal which controls the timing of the buffer memory. 
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Timine details of the interface and buffer menorv are shown in f!rcure 
3. The transfer request TR coes low at the berinnine of vertical blankine 
initiatine an arbitration for access to the buffer memory. TF the computer 
is accessinre the buffer memorv, the current bus cycle is conpleted, then 
PEADY soes hith, and the buffer memory controller cvcles throurh memory 
makine the required element and feature transfers. ‘hen this is completed, 
2EADY goes low, control of the memory is returned to the computer, and an 
interrupt is venerated requestinr data for the followine field. As in- 
dicated in the diacram, durine the ‘th Field, the computer is ceneratinr 
data for the N+lth field. 

The timings of the sicnals on the element bus are indicated in fi7ure 
4. During the transfer, the menory controller renerates: the addresses 
Ag —-A ; the clock sirnals 6 , x, , and P3 ; and the status sirnals 
CME indicating a transfer from the nenory to an element and Cr" inticatine 
a transfer from a feature module to the memory. The sicnals ZTF and Fro 
are eenerated by the synthesizer modules and initiate a controller Flenent/ 
Feature mode chanre. The three phase clock systen is used to control modules 
which have the structure shown in firure 5. Functions which use data From 
the computer durine the vertical blankine interval are disabled when the 
buffer menory accesses that varticular element by a sisnal renerated usine 

~, - This allows access to the buffer memory during $, - The third clock, 

Pr, penerates a memory write siznal. 

Time celays in the dicital processin<= modules could Droduce errors 
and shifts of the imare to the richt. This is prevented by dceskewin~ the 
output of each with a latch clocked by the master clock (9.755 ‘fiz.). 
Compensation for the resulting 102.5 nSec. delay in each module is provided 
Dy starting the X count at the besinninzg of the horizontal blanking interval 
rather than at the end. An additional shift to the right or left is then 
achieved by addins (mod 512) a constant supplied by the computer. The default 
value of ghis constant is 404 + number of elements. 


IIIT. Element and Feature Yodules 


The structure described above supports a variety of element and feature 
modules which nav be chosen and confirured accordins to the tastes of the 
artist. ur experience indicates that a larre amount of work can be produced 
with a relatively small number of elements in a standard confisuration. ‘Then- 
ever possible, a new element added to the system is confirzured in such a way 
that if the control word is set equal to zero it has no effect on the syste. 
Thas a mininum amount of reprorrammine is required followinr systen expansion. 

| Two 2zeneral classes of nodules have been developed: dicital ane hybrid. 
The hvbrid elements are: hivch-speed 0/4 converters used for reneratinzs the 
rea, sreen,and blue video signals which are converted to YTSC format in the 
gtandard wav: low-sneed D/A converters used for reneratine control voltaras, 
Field-by-field controllable, used to onerate existing voltaze controlled 
analor imare processinre systens such as keyers, raster manipulaters, etc. 
Another hybrid element is the analoc video switching matrix. four bits cé 
one control word are used to select one of sixteen inputs for one outout. 

Digital processing elements include: constant: X + constant; Y + constant: 
twelve-chinnel sixteen-line denultiplexer with output complement; and four- 
channel fiour-bit by sixty-four word memory. 
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Ticure 1 





X and Y Half Cycle Durations and Wave Forms 


x. 192.5 nSee. 
205 nSec. 

X 2 410 nSec, 

x4 B20 nSec. 

X 1.64 Sec. 

Xe 3.28 Msec. 

Xy 6. 56 Sec. 

Xy 13.12 K Sec. 
Xe 26.24 p Sec. 


x 92.48 yx Sec. 


40 


Horizontal Blanking 


v 16.66 mSec. Field Index 
Vo 63.5 ya Sec. 
V3 127 p Sec. 
Yu 254 yp Sec. 
908 Sec. 


1.91 mSec, 


Vy 2.03 mSec. 
Vy 4.06 mSec. 


y. 8.13 mSec. 


ae 16.26 mSec. 


Vertical Blanking 
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Fieure 2 
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Figure 3 
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Firure 4 
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